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Abstract We aim at studying approximate null-controllability properties of a par¬ 
ticular class of piecewise linear Markov processes (Markovian switch systems). The 
criteria are given in terms of algebraic invariance and are easily computable. We 
propose several necessary conditions and a sufficient one. The hierarchy between 
these conditions is studied via suitable counterexamples. Equivalence criteria are 
given in abstract form for general dynamics and algebraic form for systems with 
constant coefficients or continuous switching. The problem is motivated by the 
study of lysis phenomena in biological organisms and price prediction on spike- 
driven commodities. 


1 Introduction 

This paper focuses on a particular class of controlled piecewise deterministic 
Markov processes (PDMP) introduced in 0, see also [l^. Namely, we are in¬ 
terested in the approximate (null-) controllability of switch processes. A switch 

S cess is often used to model various aspects in biology (see i, [HI, 0, 0, 
), reliability or storage modelling (in Q), finance (in [0), communication 
networks (0), etc. We can describe these processes as having two components 
denoted (7, A). In our framework, the mode component 7 evolves as a pure jump 
Markov process and cannot be controlled. It corresponds to spikes inducing regime 
switching. The second component X obeys a controlled linear stochastic differen¬ 
tial equation (SDE) with respect to the compensated random measure associated 
to 7. The linear coefficients of this controlled SDE also depend on the current 
mode 7. We are concerned with a problem fitting the framework of controllabil¬ 
ity for stochastic jump systems. The main aim of the paper is to exhibit explicit 
algebraic conditions on the linear coefficients under which, given a time horizon 
T > 0 , for every initial configuration (70,3:0) the Xt component can be steered 
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arbitrarily close to acceptable targets (random variables, adapted to the filtration 
generated by the random measure). 

Let us briefly explain the applications we have in mind. The first class of 
applications comes from the theory of genetic applets. The simplest model is the 
one introduced in Q in connection to gene expression. The model can be resumed 
by the following diagram. 


G 

ka 

G* 

B-Cn 


X 


It reduces the gene expression phenomenon to a single gene which toggles between 
an inactive state G and an active one G* and to a set of proteins X. Activation 
and deactivation occur at different rates ka and Thus, the mode component 
7 is given by a random process toggling between active and inactive at specific 
rates. When active, the gene can express (some of) the products X. We can have 
a continuous expression at some rate (matrix) B per time unit or a unique burst 
rate proportional to the protein concentration. The products degrade at some 
rate A. Various external factors (e.g. catalyzers, temperature, generically denoted 
by u) can lead to the enhancement of continuous expression and a first order 
approximation would lead to an expression term B{^)u {Bu if the gene is active, 0 
otherwise). The classical method in analytical chemistry would lead to considering 

a piecewise differential behavior for the proteins concentration Xt = —A (yt) Xt + 
B{'yt)ut and, eventually a jump of intensity G (yt-) Xt-, hence leading to a switch 
model. In this kind of simple model, the proteins act as their own regulator and a 
null concentration of proteins leads to the death of the system. Our method gives 
simple algebraic conditions on the model {A (y), B (y) and G (y)) under which the 
system can be controlled from given protein concentrations to cellular death in a 
given finite time horizon. 

A second motivation comes from mathematical finance. Let us suppose that a 
controller needs to ’’predict” a vector price of some derivatives on some commodity 
(say energy) starting from previous predictions xq (whose precision is unknown). 
The fluctuations in the commodity are observed as spikes (the y component) lead¬ 
ing to a pure jump process. As long as the commodity does not change, the price 
process X is imposed to have a linear behavior (induced by the interest rate, for 
example) proportional to some A (y) matrix. The controller following the market 
information imposes a continuous linear correction term (B). When a spike is no¬ 
ticed, the price X is multiplied by some coefficient {I + C). Given a finite time 
horizon T, the actual price at time T can be any random variable with respect to 
the information given by the commodity at time T. The idea is to give explicit 
conditions on the contract terms A, B, C under which, independently of the initial 
prediction xq, the controller is able to reach the actual price (or, to be arbitrarily 
close to it). 

In the finite-dimensional deterministic setting, exact controllability of linear 
systems has been characterized by the so-called Kalman criterion. Alternatively, 
one studies the dual notion of observability via Hautus’ test as in [^. These 
conditions can also be written in terms of algebraic invariance of appropriate 
linear subspaces and the notions easily adapt to infinite dimensional settings in 

[13, [13, [ai, [13, [13, etc. 
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In the stochastic setting, a dnality approach to the different notions of control¬ 
lability would lead to backward stochastic differential equations (in short BSDE 
introduced in 0). This method allows one to characterize the exact (terminal-) 
controllability of Brownian-driven control systems via a full rank condition (see 
js^). Whenever this condition is not satisfied, one characterizes the approximate 
controllability and approximate null-controllability using invariance-like criteria 
(see [H for the control-free noise setting and 211 for the general Brownian setting). 
In the case when the stochastic perturbation is of jump-type, exact controllability 
cannot be achieved (as consequence of the incompleteness; see [13 )■ Hence, the 
"good” notions of controllability are approximate (resp. approximate null-) ones. 
For Brownian-driven control systems, the two approximate controllability notions 
are equivalent (cf. [2l|). This is no longer the case if the system has an infinite¬ 
dimensional component (see [13 treating mean-field Brownian-driven systems). 
Various methods can be employed in infinite-dimensional state space Brownian 
setting leading to partial results (see [la, [13,0, [3). For jump systems, BSDE 
have first been considered in 0 in a Brownian and Poisson random measure set¬ 
ting. Using this tool, the approach of 0 generalizes to a Levy setting (see [13 )• 
BSDE driven by random measures are studied in [4l|, while backward systems 
driven by marked point processes make the object of 0 , 0 , [ 3 - 

In this paper, we are interested in the study of approximate controllability 
properties for a particular class of piecewise deterministic Markov processes (in¬ 
troduced in all generality in 0), namely Markovian systems of switch type. We 
propose explicit algebraic invariance conditions which are necessary or sufficient for 
the approximate (null-) controllability of this class of jump systems. We emphasize 
that these algebraic conditions are easily computable. We propose several exam¬ 
ples and counterexamples illustrating the necessary and sufficient conditions in all 
generality. Explicit equivalent criteria are obtained for two particular classes of 
systems having either constant coefficients or continuous switching. The approach 
relies on duality, backward stochastic differential equations techniques and Riccati 
systems. Although, in all generality, only partial conditions are given, the main 
theoretical contribution of the paper is that it considers non-constant coefficients 
and a framework in which the jump intensity depends on the trajectory. 

In Section[2]we recall some elements on Markov pure-jump processes governing 
the mode component and piecewise-linear switch processes. Using the controlla¬ 
bility operators and the adjoint BSDE, we give a first (abstract) criterion for 
approximate and approximate null-controllability in Theorem [T] The study of al¬ 
gebraic invariance characterizations for the approximate null-controllability forms 
the objective of Section [3l The previously proven abstract tool allows us to obtain 
two necessary conditions for approximate null-controllability in Propositions [1] and 
[2] as well as a sufficient criterion in Proposition [S] These conditions are explicit 
and involve invariance or strict invariance algebraic notions. By means of coun¬ 
terexamples in the framework of bimodal switch systems, we show in Section 0] 
that no hierarchy can be established between these necessary conditions and/or 
the Kalman criterion for the control of the associate deterministic system. We 
exhibit a two-dimensional example in which the necessary condition of Proposi¬ 
tion [1] fails to imply the deterministic Kalman condition and, hence, may not be 
sufficient for general controllability (see Example [T|). Even if both the necessary 
condition of Proposition [1] and Kalman deterministic condition are satisfied, the 
system may fail to satisfy the condition of Proposition and, thus, might not 
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be approximately null-controllable (see Example [2]). In a similar way, the neces¬ 
sary condition of Proposition [2] and Kalman deterministic condition do not (in all 
generality) imply the condition of Proposition [T] (see Example |31) • In the frame¬ 
work of systems with constant coefficients fSubsection 14.11) . we prove that the 
necessary condition of Proposition [2] is also sufficient. The basic idea is to give 
a deterministic characterization for the local viability kernel of KerB* by means 
of linear-quadratic control techniques in Proposition H] which allows to weaken 
the sufficient condition (see Criterion n. This is made possible by Riccati tech¬ 
niques which, in this particular setting, concern deterministic equations (instead 
of backward Riccati stochastic systems). We prove that for this class of systems, 
the necessary and sufficient condition (given in Criterion [3]) can be weaker than 
the sufficient one in Proposition [3] (see Example H]). The second class for which we 
can achieve complete description of approximate null-controllability is that of con¬ 
tinuous linear systems of switch type. This forms the objective of Subsection 14.21 
The proof of the equivalence Criterion [3] can be easily extended to more general 
systems in which the mode is equally influenced by the continuous component. It 
relies on explicit construction of stabilizing open-loop control processes. Einally, 
we give a hint on work to come in Section [5l 


2 A Coefficient-Switch Markov Model 

2.1 Markov Jump Processes 

We briefly recall the construction of a particular class of Markov pure jump, non ex¬ 
plosive processes on a space 1? and taking their values in a metric space {E, B {E)). 
Here, B (E) denotes the Borel a-field of E. The elements of the space E are re¬ 
ferred to as modes. These elements can be found in [l5| in the particular case of 
piecewise deterministic Markov processes; see also Q. To simplify the arguments, 
we assume that E C M™, for some m > 1. The process is completely described by 
a couple (A, Q) 

(i) a Lipschitz continuous jump rate A : E —>■ M-). such that sup |A(0)| < cq 

0eE 

and 

(ii) a transition measure Q : E — > V (E), where V [E) stands for the set of 
probability measures on {E,B {E)) such that 

( m 1) <3(7, {7}) = 0 , 

( m 2 ) for each bounded, uniformly continuous h G BUG , 
there exists rjfi : K —> K+ s.t. r]fi ( 0 ) = 0 and 
I/b ^ (^) Q { 7 , d9) - Jj^h {9) Q ( 7 ', d9)\ < rih {\-/ - y\) . 

(The distance |7 — 7 ^| is the usual Euclidian one on K"*.) Given an initial mode 70 € 
E, the first jump time satisfies (Ti >t)= exp(—tA( 7 o)). The process 7 * := 
70 , on t < T 1 . The post-jump location 7 ^ has Q ( 70 , •) as conditional distribution. 
Next, we select the inter-jump time T 2 —T 1 such that (T 2 —Ti>tj Ti, 7 ^) = 
exp (—tA ( 7 ^)) and set 7 * := 7 ^, if t G [Ti,r 2 ) . The post-jump location 7 ^ satisfies 
p 0 , 7 o ^^2 ^ ^ j yj, Ti, 7 ^) = Q ( 7 ^, a) , for all Borel set A C E. And so on. Similar 
construction can be given for a non-zero initial starting time (i.e a pair (t, 70 )). 



Title Suppressed Due to Excessive Length 


5 


We look at the process 7 under and denote by F° the hltration (-F[q tj := a {yr : r G [0, t]}) 
The predictable cr-algebra will be denoted by and the progressive a-algebra by 
Prog°. As usual, we introduce the random measure p on 17 x (0, 00 ) x E hy setting 

= X] l(TfcM. 7 r,(„)(c..))GA> forallcuGr?, A e B {0,oo) x B {E). 

k>l 

The compensator of p is A (y^-) Q ( 7 s_, dS) ds and the compensated martingale 
measure is given by 


q (ds, dO) := p (ds, dd) — X ( 7 ^-) Q {js-,d9) ds. 


Following the general theory of integration with respect to random measures (see, 
for example 113), we denote by the space of all V^^B (E) - measurable, 

valued functions Hs (tu, 6 ) on 17 x K-i- x E such that 


E' 


0 . 7 o 


= E°’’^“ 


/ / \Hsi9)\^pids,de) 

Jo Je 

f f \Hsi9)\^ Xiy,-)Qiys-,d9)ds 

Jo Je 


< 00 , 


for all T < 00 .Here, M G N* and r > 1 is a real parameter. By abuse of notation, 
whenever no confusion is at risk, the family of processes satisfying the above 
condition for a fixed T > 0 will still be denoted by (p\ . 


2.2 Switch Linear Model 

We consider switch systems given by a process {X{t),y{t)) on the state space 
K" X E, for some n > 1 and a family of modes E. The control state space is 
assumed to be some Euclidian space d > 1. The component X{t) follows a 
differential dynamic depending on the hidden variable 7. We will deal with the 
following model. 

f dXf = [A {7s) + Bsus] ds + jj^C {'ys-,9) (ds, d9) , s> 0 , . . 

\ Xq= X. '' '' 

The operators A (7) G are such that sup..|,g^ \A (7)! < ao, for some positive 

real constant ao G M. The coefficient 

B G (f? X 0 Leb-,R'^^^'^ , 

that is Bt (a;) G for alH > 0 and all tj G 17, the function B is measurable 

and locally bounded in time (i.e. sup^gjQ 7.] < cp, P°''>'» — a.s., for some 

positive real constants cp and all T > 0). Particular evolution will be imposed on 
B afterwards. The coefficients C {^,9) G for all ^,9 G E satisfy 

sup j IC {7, 0 ) 1 ^ A (7) Q {7, d 0 ) < 00, for all T > 0 . 
jeE Je 


t>o ' 
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Moreover, the control process u : 17 xK-). —> is an K^^-valued, F°— progressively 

measurable, locally square integrable process i.e. 


E°’^“ 



< oo. 


The space of all such processes will be denoted by Uad and referred to as the 
family of admissible control processes. The explicit structure of such processes can 
be found in Proposition 4.2.1], for instance. Since the control process does 
not (directly) intervene in the noise term, the solution of the above system can 
be explicitly computed with Uad processes instead of the (more usual) predictable 
processes. 

The reader acquainted with the literature on PDMP may note that our pro¬ 
cesses are very particular. The evolutions concern full spaces and this is why jumps 

from the border cannot occur. Between jumps, the couple ( 7 , x) has (0, [A ( 7 ) — J C (j,d) X ( 7 ) Q ( 7 , dO)] x -|- Bu) 
as speed, the jump intensity is A ( 7 ) and the post-jump measure is Sa:^c(j,e)x (d-y) Q ( 7 , dO). 

The reader is kindly asked to recall the financial example we gave in our intro¬ 
duction. Within this framework, in order for our model to be coherent in some/any 
finite time horizon T > 0, it should be able to provide a ’’guess” that is not very far 
from the actual price at time T. In other words, by eventually changing the control 
parameter u, we should be able to simulate any possible (regular) price at time T 
or, equivalently, any square-integrable random variable which is measurable w.r.t. 

-^[o,T] (the natural a-field generated by the random measure p prior to time T). 

Definition 1 The system o is said to be approximately controllable in time T > 0 

if, for every 70 G i?, every ^'[Q j’j-measurable, square integrable ^ G (f7, 

every initial condition x G K” and every e > 0, there exists some admissible control 

process u G Uad such that < £■ 

The system m is said to be approximately null-controllable in time T > 0 if 
the previous condition holds for ^ = 0 (P°’'’'“-a.s.). 

For deterministic systems (cf. [^, [s^, etc.) or Brownian-driven control sys¬ 
tems (e.g. Hi, a, ) , controllability is known to be associated to observability 
properties for the dual (linear) system. In the stochastic framework, one is led to 
backward stochastic differential equations. Following this intuition, we consider 
the following system. 


dV,^'^ = 
+ 


-A* ( 7 O C* {juO) {9) A ( 7 i) Q ( 7 t. dO)] dt 


{e)q{dt,de).. 


( 2 ) 


= e G (17, ■ 

The solution is a couple 

(y.^’^,Z^’^ (•)) {qx [0 ,r], Pro 5 °,P°’'^“ ® Lefe;K") x (p;K") 

i.e. such that is progressively measurable and z'^'^ is x B (F)-measurable 
and 


E 


0,70 


f 


y 




ds 


-he' 


0,7o 


^ JJzJ’^ie)\\ij,-)Qij,-,d9)ds 


< 00. 
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For further details on existence and uniqueness of the solution of BSDE of this 
type, the reader is referred to 0, 0 (see also [il|). (Although the results in 0, 
are given in the one-dimensional framework for the purpose of the cited paper, 
the assertions in 0 Lemmas 3.2 and 3.3, Theorems 2.2 and 3.4] hold true with 
no change for the multi-dimensional case. Also the assumptions in 0 Hypothesis 
3.1] are easily verified in our model.) 

We get the following duality result which specifies the connection between the 
above equation m and the controllability of equation (HD- 


Theorem 1 The system m is approximately controllable in time T > 0 if and only 
if, for every jo £ E, the only solution (y^’^, of the dual system 0 ) for 

which € KerBf, P*^’"’''’ 0 Le 6 almost everywhere on f2 x [0,T] is the trivial (zero) 
solution. 

The necessary and sufficient condition for approximate null-controllability of m is 
that for every 70 G E, any solution (y^’^, zj'^ (•)^ of the dual system m for which 
Y^’^ € KerB) , almost everywhere on Q x [0, T] should equally satisfy 


Y 


TX 


= 0 . 


Proof Let us fix T > 0 and 70 € E. As usual, one can consider the (continuous) 
linear operators 


7^T : Uad L" ( 12 , .F[o,t] , ; K”) , Et (m) := for all u € Uad, 

Jt : K" —^ ( 12 , , '^T (®) = for all xgM". 

One notices easily that = TZp (a:), for all u G Uad E'-nd all xgK". Hence, 

approximate controllability is equivalent to TZT{Uad) being dense inL^ (12, J'jq yjjP® 
while approximate null-controllability is equivalent to Xp (R") being included in 
the closure of 7iT{Uad) (w.r.t. the usual topology on lY ( 12 , J^[g .t],p°’'^“;IK"))- 
Equivalently, this leads to 

Ker (TZp) = {0} (resp. Ker (TTr) ^ Eer (Tt) ). 

One easily gets, using Ito’s formula (the reader may consult Chapter H, Section 
5, Theorem 5.1], for example). 



' fT . . ■ 


/ (BtUt,Y^^’^)dt 

Jo ^ ' 


for all T > 0, 2 ; G R", u G Uad and all ^ G (l2, , P°’’^“; R") . For a; = 0, one 

identihes 

For u = 0, one gets 

It (0 = if 


’T'“;R") , 


The assertion of our theorem follows. 
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Equivalent assertions are easily obtained by interpreting the system m as a 
controlled, forward one : 

r dy/’” = {-A* (70 y/>" - 4 c* vt {e) \ (7*) g (7*, dd)) dt 
s + Ie’^* (^) ’ (2) 

[ Fq*'’” = y e M". 

We emphasize that in this framework, the family of admissible control processes 
is given hy v G (p;®"). This remark will be of particular use for sufficiency 
criteria. 

Theorem 2 The system m is approximately controllable in time T > 0 if and only 
if, for every initial data yo G E, y G R" and every predictable control process v G 
C?' (piR") such that y/’” G KerBf, almost everywhere on Q x [0,r] , it 

must hold = 0, ¥^’'^°(^Leb-almost everywhere on Q x [0,T] . 

The system m is approximately null-controllable in time T > 0 if and only if, for 
every initial data yo G E, y G R" and every predictable control process v G (p;R”) 
such that Yf’'" G KerBf, V^''^°^Leb almost everywhere on Q x [0,r] , it must hold 
y = 0. 

Remark 1 The reader should note that for every initial data y G R" and v G 
C? (piR"), one identifies the couple {Y^''’,v. (•)) with the solution ^Y^'^, (•)^ 

for ^ = y|!’’'. Conversly, for every ^ G (i?, , the solution of ([2]) 

is given by the couple (y^’’',w. (•)) by picking y = yJ^'^ and v = Thus, the 

previous Theorem is only a reformulation of Theorem [TJ 


3 Explicit Invariance-Type Conditions 

As one can easily see, the approximate (null-) controllability conditions empha¬ 
sized in the previous result involve Ker (Bf). In order to obtain the (orthogonal) 
projection onto this space, one uses the Moore-Penrose pseudoinverse of Bt 

Bt ■= lim (B^Bt + Bt 

5-S-0+ ^ ^ 

(given here by means of Tykhonov regularizations). However, even if Bt is continu¬ 
ous, can only have continuity properties if these matrices have the same rank. 
In this framework, the results on derivation of H+given in [l^ apply. To simplify 
the presentation (by avoiding fastidious rank conditions), we assume, throughout 
the remaining of the paper (and unless stated otherwise), B to satisfy a linear 
system 

J dBt = PytBtdt 

\ Ho = 5 ° (70). ’ 

where (3 G R^^'^ and the space E to be compact. Then, one computes explicitly 
the predictable process B 

Bt = ^ ^ g- ft hisds ^^0 ^ for ah t > 0. 
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It is clear that Rank (Bt) = Rank ( 70 )) , for all t > 0. Moreover, BtB^ = 
n^Ker[B*'))^ is the orthogonal projector onto the orthogonal complement of the 

kernel of B^. In particular, 




( 70 ) (^B° ( 70 )^ 


= n 


ifej'[(B»(7o))*] 


We recall the following notions of invariance (see [12 


Definition 2 We consider two linear operators A and C defined on some 

vector space X and taking its values in K". 

(a) A set V C M" is said to be A- invariant if AV C V. 

(b) A set V C K" is said to be {A;C)- invariant if AV <ZV + ImC. 

(c) A set V C K” is said to be feedback (yI;C)- invariant if there exists some 

linear operator T : K" — > X such that {A + CT) V C V (i.e. is A + CR- 

invariant). 


If the space X is K" or some functional space with values in M” (of L^’-type, 
for example), one can also define a notion of (A;C)- strict invariance by imposing 
that AV C V + Im {CBv) ■ Of course, any strictly invariant space is also invariant. 

We will now concentrate on some explicit algebraic conditions which are either 
necessary or sufficient for the approximate (null-)controllability. These criteria 
apply to general systems (without specific conditions on the coefficients). In the 
next section, we will discuss particular cases when these conditions are necessary 
and sufficient. We equally present several examples showing to which extent our 
conditions are necessary and sufficient. 


3.1 Necessary Invariance Conditions 


3.1.1 First Necessary Condition 


We begin with some necessary invariance conditions in order to have controllability 
for the system O- Without any further assumptions on E and Q, we have the 
following. 


Proposition 1 If the system m is approximately null-controllable, then, for every 
70 € E, the largest subspace of Ker (5° ( 70 ))* which is A* ( 70 )—A ( 70 ) Jg C* ( 70 , 0) Q ( 70 , dO) 


- invariant is reduced to the trivial subspace {0 


Proof Let us assume that our system is approximately null-controllable at time T > 
0 and let us fix x e M" and 70 € E. Since 70 is fixed, we drop the dependence of 70 
in . Then, for every e > 0, there exists some admissible control process u £ Uad 
such that E < e. Since u is assumed to be progressively measurable, it 

can be identified prior to jump time Ti, with some deterministic borelian control 
still denoted by u (see, for example, [s^. Proposition 4.2.1]). One notes easily that 

£>e[|x^’“|"] >e [|a^’“|"it,>t] = |<?7o(T;a:,u)|"P(ri >T) 
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where cq is an upper bound for the transition intensities A and satisfies the 
deterministic equation 


II 

0 

(A (70) - A (70) /g C (70, 0) Q (70, de)) (s; x,u) 

+B° (70) 

II 

H 

0 



Then this linear system with mode 70 is controllable (keep in mind that since 
the coefficients are time-invariant and we have finite-dimensional state space, the 
different notions of controllability coincide). Kalman’s criterion of controllability 
yields 

Rank \b, AB, = n, 

where A =A (70) — A (70) C (70, 0 ) Q (70, dO) and B =B° (70) and this implies our 
conclusion. 

In the next section, we shall exhibit various frameworks (continuous switching 
systems, corresponding to the case C = 0 ) in which this condition is equally 
sufficient for the approximate null-controllability as well as counterexamples for 
the general setting. 

3 . 1.2 Second Necessary Condition 

Whenever 7 £ i?, the operator C* (7) G C (L^ {E, B (E) , A (7) Q (7, •); R"); R") (the 
space of linear operators from {E, B {E) , A (7) Q (7, •); R”) to R”) is defined by 

c*(7)0= / c*{-/,e)<j>{e)x{'y)Q{y,de), 

J E 

for all {E, B{E),X (7) Q (7, ■); R"). 

Let us now assume the set of modes E to be finite. This assumption is made 
in order to simplify the arguments on the local square integrability of feedback 
controls in the proof of Proposition [ 2 l We dehne 

Acc (k, 70) = € E : 30 < k' < k s.t. (70; 7^) > o|, 

the family of accessible modes in at most fc > 0 iterations starting from 70. (In the 
infinite setting, accessible states can alternatively be defined using the transition 
kernel). We use the obvious convention Acc (0,70) = {70}- We set I4 to be the 
largest subspace V C Ker (70)) *j such that 

A*{-f)VcV + Im {C* (7) nv)=V + C* (7) (l^ {E, B{E),X (7) Q (7, •); K)) , 

for all 7 G Acc (fc, 70) (i.e. the largest space {A* (7); C* (7))-strictly invariant for all 
7 G Acc (k, Jo)). All these subspaces depend on the initial mode 70. Whenever no 
confusion is at risk, this dependency is dropped. 

Remark 2 (i) The reader is invited to note that Vo is the largest subspace V C 
Ker (70)) *j which is {A* (70) ;C* (70) IIy)-invariant. 

(ii) If the family of modes E is hnite, then I4 = V^ardiE): for all k > card {E). 
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The following condition is eqnally necessary in order to have controllability. 

Proposition 2 If the system m is approximately null-controllable, then the subspace 

Voo ■= n 14 reduced to {0} . 
k >0 


Proof It is obvious from the definition that the family (I 4 )j,>g is decreasing. We 
set (7) := C* (7) Ily ^, for all 7 e if. Then, due to the definition of Too, one gets 
that Too is {A* (7); (7))-invariant 

A* (7) Too C Too + Im (7), 

for every 7 e U Acc{k,^o). Using [s^, Theorem 3 . 2 ] (see also [l^, Lemma 4 . 6 ]), 
k >0 

the set Too is equally (T* (7); Cjo (7)) —feedback invariant. Thus, there exists some 
(bounded) linear operator 

F (7) : M” ^ L" {E, B{E),\ (7) Q (7, ■);»”) 


such that Too is A* (7)+C* (7) IIv^^F (7)- invariant. We consider the linear stochas¬ 
tic system 

r dy/.'io = - {A* (7O + c* (7t, 0) nv^F{yt) {e) x M Q (7*. de)) Yl^°dt 
\ -h Yiy^F{e){dt,de), t> 0 , 

[ = y G Too C M”. 


Then, it is clear that = Y^’^ , where T/’" 

of ( 131 ) associated to the feedback control 


is the unique solution 


^feedback jjy^F ( 6 ) Y^_:^°, t > 0. 


We wish to emphasize that the solution Y.^’'^° will be adapted and cadlag and, 
thus, ig ajj admissible control (for details on the structure of predictable 

processes, we refer the reader to fisl . Equation 26 . 4 ], Proposition 4 . 2 . 1 ] or 
y. Appendix A 2 , Theorem T 34 ]). For every initial datum y G Too, it is clear 
that the solution Yy'^° G Too, 0 Leb - almost everywhere. In particular, 

feedback „ 

= 0 , ^Leb - almost everywhere. If our system is approximately 
null-controllable, due to Theorem [ 2 ] one has y = 0 and the conclusion of our 
proposition follows recalling that y G Too is arbitrary. 


3.2 Sufficient Invariance Conditions 

As we did for C* by identifying C* (7, •) with a linear operator 

C* (7) G F (l" {F, B{F),X (7) Q (7,.); M"); , 

we let X (7) G £ (L^ {F, B {F ), A (7) Q (7, •); M"); K") be associated to the identity 
(i.e. we define it by setting 

X(7)<^= / <f{e)X{j)Q{y,de), 

Je 
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for all G [E, B (E), X (7) Q {7, •); M")). As we have seen, the (second) neces¬ 
sary condition for approximate null-controllability involves some subspace Voo C 
Ker (70)]*^ such that 

A* (7) Voo C Voo + ImC (7) = Voo+lm {C* (7) i 7 y^) , 

at least for 7 = 70- A slightly stronger (yet similar) condition written for 70 turns 
out to imply approximate null-controllability. 

Proposition 3 If, for every 70 G E, the largest subspace of Ker (7o)]*^ which 

is (A* (70); (C* (70) +1 (70)) ^Ker{[B°{'yo)]*)) ~ 'if^'variant is reduced to { 0 }, then the 
system m is approximately null-controllable. 

Proof For fixed 70 G E, we drop the dependency on 70 in For y G K" and 

V G (p; R”) . we let denote the unique controlled solution of (| 3 ]). Ito’s 
formula (see [23 or [l^ Theorem 31 . 3 ]) yields 

= /^ (^ - ^KeriB^)) (^) 1 i^t, dO) - (/ - A* (yt) Vr dt 

- ^ - B^er-(Br)) c* {e) vt {e) x M q {^ude) dt. 

Whenever = 0 , P®Le6 almost everywhere on 17 x [ 0 , T], one easily gets (by 

computing quadratic variation) 


0 = E 



7-77 


K( 


r.(Bj))^4^)| X{je)Q{^8,de)ds 


We recall that w is a predictable process and (see fl^ . Equation 26 . 4 ], Propo¬ 
sition 4 . 2 . 1 ] or U Appendix A 2 , Theorem T 34 ] for further details) 


Vt {d) = Vi {B,t) lt<Ti + ^ Vn (o,t,^^, ^ j lT„_i<t<T„, 

n>2 


for some (deterministic) measurable functions v„. In particular, if A (70) > 0 (oth¬ 
erwise, we have a deterministic system), then 

m (0,7) G Aer (Bt*) = Aer Qb° ( 7 o)j j, (4) 

for Q ( 70 , ■)®Leb almost all ( 6 , t) G 7? xK-i-. We recall that, up to Ti, Y'^'’" coincides 
with (jP'’", the solution of the deterministic system 

[ dcff" = (-A* (70) (jif" - /g (C* (70, e) -h 7) Vi {e, t) X (70) Q (70, d 9 )) dt, 
{t> 0 , 

[ = y G K". 
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As a consequence of the fact that € Ker (70)] *j and T\ is exponentially 

distributed, it follows that 


(^A* (70) (C* {e) +1) VI {e, t) X {70) q (70, ae)^ g Ker ( [b° (70)] , 

( 5 ) 

for almost all t > 0 . At this point we recall the iterative construction of invariant 
spaces. To this purpose, let us introduce the linear subspace 




y' G Ker (70))*] : 

< 3MGL2(£;,S(£;),Q(7o,d6l);Aer[(B°(7o))*])s.t. . 
A* {10) y' + (c* (70) +X(7 o))m G Ker (70))*j ■ 


( 6 ) 


Then, (| 1 ]) and (O imply that 4’^’'’ G , for almost all t > 0 . Hence, using the 
linear character of we infer 


A* (70) {c* (70, e) + 1) VI (6, t) X (70) Q (70, de)^ g i /°, 

for almost all t > 0 . We then define 

yi ^iy' GV° (^E,B{E),Q{'yo,de)-Ker[{B° (70))*]) s.t. 

1 A*( 7 o)j/' + (C*( 7 o)+X( 7 o))Mef"°. 

and we deduce, as before, that G for almost all t > 0 , and so on for 
y*, i > 1 . We recall that 1 /* C M”. Hence, V ■.= n F* is a linear subspace of 

2=0,n 

Ker (70)) *j which is [A* (70); C* (70) + T (7o))-invariant and such that G 

y, for almost all t > 0 . By assumption, V = { 0 }. Thus, 4>\’'" = 0 for almost all 
t > 0 and, due to the continuity, y = 0 . In particular, it follows that, whenever 
= 0 , P®Lefe almost everywhere on 17 x [ 0 , T], one has to have y = 0 i.e. our 
system is approximately null-controllable. 

Remark 3 (i) If W is the largest subspace of Ker (70)) *j which is (A* (70); C* (70)) —strictly 
invariant, then it is also (A* (70); (C* (70) + T (70)) 77 vv) - invariant and, hence, 

(a* (70); (C* (70) +I (70)) -^tfer[(B“(7o))*])‘ invariant. Under the sufficient condi¬ 
tion described in the previous proposition, it follows that W = { 0 } . 

(ii) The space U° is what is called the viability kernel of Ker |^(B°(7o))*j 
w.r.t. the deterministic system (i.e. the larger set of initial data y such that the 
solution stays in Ker (7o))*j). We emphasize that a solution starting from 

U° stays in (prior to jump). In other words, this viability kernel is viable w.r.t 
the deterministic system. However we cannot guarantee that this is still the case 
w.r.t. the stochastic equation (the controls u may not take their values in U°).This 
possible non-viability is the reason we cannot (in all generality) go any further to 
obtain a result similar to the one in Proposition [ 2 ] 

(iii) In the definition dSD, one can replace (C* (70) + X (70)) by C* (70). However, 
in general, this is no longer the case in U* when i > 1. 
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4 Examples and Counterexamples, Equivalent Criteria 


We begin this section with some simple counterexamples. We examine several 
cases. First, we show that the first necessary condition (given in Proposition [1]) 
may fail to imply the controllability of the associated deterministic system, and, 
hence, of the stochastic one. In a second example we show that it is possible that 
the first necessary condition (given in Proposition [1]) together with the Kalman 
condition for the controllability of the deterministic system should fail to imply 
the second necessary condition (of Proposition [2]) . The third example shows that 
for multimode systems (i.e. non-constant coefficients), the necessary condition of 
Proposition [2] may fail to imply the condition given in Proposition [1] (and, thus, 
is not sufficient for the general approximate null-controllability). We emphasize 
that in the last two examples the Kalman condition for controllability of the as¬ 
sociated deterministic system is satished but it does not imply the approximate 
null-controllability of the initial stochastic system. 

Let us consider some simple examples in which the necessary condition given in 
Proposition[T]is satished and it fails to imply the approximate null-controllability. 
To this purpose, we consider a two-dimensional state space and a one-dimensional 
control space (n = 2, d = 1). The systems will be bimodal governed hy E = {0,1} , 
the control will only act on the hrst component of the state space ( 0 ) = ( 1 ) = 


:= 


1 

0 


. The control matrix Bt is set to be constant (its equation has /3 = 0). 


The pure jump component will switch between 0 and 1 in exponential time with 
the same parameter A (0) = A(l) = 1, Q{0,d9) = Si{d9), Q(l,d0) = 5o{d9). 

One easily notes that Ker ® 

1 


= I '■ y ^ • Let us consider C {i,j) = 


0 I 

h 0 


, for all i,j G E. 


Example 1 We Hrst consider yl (0) = A (1) = 0 G We get 


( 7 ) 0 ) ’ 1 &E. 

One notes that 

(^A* ( 7 ) - ^ ( 7 ) ^ C* ( 7 , 9) Q ( 7 , d9)^ ( y ) = ( "o' ) (^T) 

if and only if y = 0. Hence, the condition given in Proposition [1] is satished. The 
system © has the particular form 




= d 


(x,y),u 

(x,v),u 

Vs 


X. 


0 “ 



( (x,y),^,u \ 


q [ds, d9) , 


However, one easily notes that E = y, for all s > 0. Thus, by taking 

1 / ^ 0 , the previous system cannot be steered onto arbitrarily small neighborhoods 
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Due to this example, the reader will get an obvious necessary condition (at least 
for constant A,B^) : in order for the system o to be approximately controllable 
if 5 ° (7) = 5 ° and A (7) = A, for all 7 € -E, the associated deterministic system 
(corresponding to the expectation of X) 

f dxs'^ = ^Axg’^ + B°Us^ ds, s > 0 
1 X,U 

l®o =*> 

should be controllable or, equivalently, due to Kalman’s criterion. 

Rank AB° ,..., = n. 


Naturally, this condition is not satisfied in the previous example. 

At this point, the reader may be interested in knowing if this supplementary 
necessary condition (the controllability of the associated deterministic system) 
implies the approximate null-controllability for the stochastic system (at least for 
constant A,B°,C). The answer is negative as shown by the following. 


Example 2 The coefficients 5 ° and C are taken as before and the framework is 
similar. However, we take A ( 0 ) = A ( 1 ) = A := f g V Then, we get 


A* (7) - A (7) j C* (7, e)Q{'y,de) = 2 ^ , for all 7 G E. 

and the condition given in Proposition[T]is again satisfied (as in the previous case). 
It is clear that AE° ~ and, thus, the Kalman condition is also satisfied. 

Nevertheless, if one considers 


^=(- 1 ) 


P([0.T],£;) 


0 

2T 


,Yf.= i-l) 


p([07]E) 


and Zt := — 2 Yt_, (Y, Z) is the unique solution of the BSDE ([ 5 ]) with hnal data 
It is clear that Yt € Ker for all t G [0,r]. However, Yq = 

almost surely and, due to Theorem [U the system is not approximately null- 

controllable. (Alternatively, one may want to note that Voo = Vq = Ker 
and apply Proposition [ 2 ] to get the same conclusion). 


The examples we have seen so far show that, even for the case in which the 
coefhcients are constant, the necessary condition given in Proposition [ 1 ] might 
not be sufficient. In the same framework, even though we have the exact control¬ 
lability of the associated deterministic system, the stochastic one might not be 
approximately null-controllable. 

It is worth pointing out that, in particular cases (constant coefficients and 
Poisson random measure-driven systems), the necessary condition given by Propo¬ 
sition [ 2 ] turns out to actually be sufficient. This will be the purpose of the next 
Subsection. However, for general systems, this condition may also fail to imply 
the approximate null-controllability. To illustrate this assertion, we consider the 
following switch system. 
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Example 3 We let n = ?., d = 1 , E = {0,1}, (0) = (1) = 5 ° := ^Oj ,,5 = 0, 

A (0) = A(l) = 1, <3(0,50) = 5\{d6), <3(1,50) = 5o{d6). Moreover, we denote 
byei= |oj,e 2 = |lj,e 3 = foj. One easily notes that Tt'er = 


0 0 0\ 


/O 0 0 

10 0 

, A(l) := 

0 0 1 

0 10/ 


\ 1 0 0 


0 0 0 j , <7 ( 1 , 0 ) := j 0 0 1 j . The reader is invited to note that Rank A ( 0 ) 53 ° A ( 0 )^ 53 ° 


3 and, thus, the associated deterministic system is controllable. The same asser¬ 
tion holds true for A ( 1 ) replacing A ( 0 ). Moreover, A ( 0 )* {ye2 + 263) = yei -)- 262 , 
< 7 ( 0 , 1 )* ( 3/62 + zes) = 262 - Hence, the largest subspace of Ker ^( 53 °)*^ which is 
[A ( 0 )* ; <7 ( 0 , 1 )* 7I^gr((50)»))-invariant is span (es). Similarly, the largest subspace 
of Ker ^(53°)*^ which is (A ( 1 )* ; <7 ( 1 , 0 )* i7;fgr((B0)*))-invariant is span (62). We 
deduce that the space Wo appearing in Proposition [ 2 ] is reduced to { 0 } . However, 


(O)-A(O) / <7* (O,0)g(O,50) 

J E 


/ 010 \ 
0 0 0 
\0 0 0 / 


and the space span (es) is A* ( 0 ) — A ( 0 ) C* ( 0 , 0 ) Q ( 0 , 50 )-invariant. Similar as¬ 
sertions hold true for 70 = 1 . It follows that, although the necessary condition in [ 2 ] 
holds true, the necessary condition given by Proposition [ 1 ] is not satisfied. Hence, 
the system is not approximately null-controllable. 


4.1 The Constant Coefficients Case 


Throughout the subsection, we fix 70 £ i? and drop the dependency of 70 in 
We consider the following particular form of the system ©• 

/ 5 X^“ = -h Bus] ds + Jj^C ( 0 ) ( 5 s, 50 ), s > 0 , 

I Xq= *. ■ 


where A G B G are hxed and <7 ( 0 ) G for all 0 G such that 

A (7) <3 (7, 50 ) is independent of 7 G 53. In this case, q corresponds to a (compen¬ 
sated) Poisson random measure. We let p denote the Poisson random measure 
and V [dO] := A (7) Q (7, 50 ) be its Levy measure in this framework. Let us point 
out that more general cr-finite Levy measures satisfying a suitable second order 
moment condition can be considered and the arguments are identical. However, 
for coherence reasons, we work with the (hnite) measure given before. We assume 
that <7 G (i 3 , H (J5) , i/; . As we have already hinted before, we interpret 

the system © as a controlled, forward one. In this case, the system m takes the 
particular form 


/ 5 y/’" = C* ( 0 ) Vt ( 0 ) E ( 50 )) dt -h Vt ( 0 ) q {dt, dd), t> 0 , 

\ = 3/ G M". 



Title Suppressed Due to Excessive Length 


17 


Let us point out that, in this case, Proposition [2] yields that, whenever the 
system © is approximately null-controllable in time T > 0, the largest subspace 
Vo C KerB* which is (A*;C*7Ivij)-invariant is reduced to {0} (i.e. the largest 
subspace of KerB* which is (A*;C*)—strictly invariant is reduced to {0}). We 
recall that the linear operator C* : {E, B {E), v, M") —>• K" is given by 


C*(j) = C* {9) (j) (9) V {d9 ), for all </> G (E, B {E ), v, K”). 

Je 

We wish to prove that this condition is also sufficient in order to have approximate 
null-controllability. In fact, in this context, we show that not only do we have 
approximate null-controllability, but we actually get approximate controllability. 

A careful look at the proof of Proposition [3] and Remark [3] (ii) leads to consid¬ 
ering 


Viabioc 



y G KerB* : BT > 0, v £ (p; s.t. 

G KerB*, P®Le6 - a.s. on O x [0,T] 


}■ 


When y G Viabi^^ [KerB *), one finds a solution which is constrained to KerB*. 
The control problems with state constraints can be transformed into unconstrained 
ones by adding a penalty when the constraint is not satisfied. Heuristically, in 
this context, one may associate to y £ H." a cost which involves a penalty term 


iVE 


f 

JO 


Ul, 


[KerB* 


{Yr 


dt 


and allow N ^ oo. Since this type of cost belongs 


to the class of LQ (linear-quadratic) control problems, it can be addressed with the 
theory of Riccati equations. We consider the sequence of (deterministic) Riccati 
equations 


dK,^ = 

.K^ = 0- 


-K 


Na* - AKf^ 


■NB, 


[KerB*] 


-K^ J^C*i9)(^I + K^) C[9)i 


[d9)K^ 


dt, t > 0, 


The proof for the existence and uniqueness of the solution is quite standard. It 
relies on successive iterations (see |42L Chap. 6, Cor. 2.10 and Prop. 2.12 ]) and 
will be omitted from the present paper. Obviously, the sequence is 

non-decreasing in the family <S^ of symmetric, positive semi-definite matrix. 


Remark 4 In fact, in the theory of stochastic control, one would be led to consider 
the following BSDE 

' dRf 

= (r^A* + ARf - dt + Rf (0) q [dt, d9) 

' + Ie {ft"" (^)) * (^)) ft"" (S) ^ {d9) dt, 

where [9) := (c (0) Rf - Rf [9]) , t G [0,T]. 

^R^ = 0, I + R^ + [9) > 0, for almost all t £ [0, T]. 

However, in our particular setting, the solution of the BSDE is got by setting 
Rf = K^_^ and Rf = 0. 
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We get the following. 

Proposition 4 If y £ Viabig^ [KerB*), then, there exists T > 0 and v £ C? (p; R") 
such that £ Viabigc {KerB*), P(g)Le& — a.s. on O x [0,T]. 


Proof Step 1. We claim that 


Viabiof, (^KerB*'j = K := G R" : 3T > 0 s.t. (^K~y,y'^ < cxo| . 

Using the definition of Viabi^^ [KerB*), we are led to consider, for y £ Viable,, [KerB *), 
some T > 0 and v £ C? (p;R") such that G KerB*, ¥®Leb — a.s. on i? x [0,T]. 

Ito’s formula applied to for s £ [t,T] yields 


v,[[K^_,Yr ,Yr)] 

j \vs{0)'^ V {d6)ds 


= E 


-E 


+ A^E 


^[KerB*]^ ds 


j + K^_,y Vs (6) - (^I + K^_,) ~^C{e) 




[t,T]xE 


V (dd) ds 


For t = 0, it follows that 


{KtV^V^ < E 



jus (d)f V (dS) ds 


for all A'" > 1, 


hence t/ G K. Conversely, if y G IK, and T > 0 is such that lim ( kS y,y)=:c<oo, 
one takes the feedback control sequence 

nf [6) := (/ + K^.sY" C {6) K^.sY^lf, 

to get 


r'^ c 2 

/ / (^)| i^{de)ds 

+ A^E 

f\niKerB*Y 

Jo JE ' ' 


Jo ' ^ ^ ' 


< c. 


Hence, one hnds a (sub)sequence ,Y^'^ j weakly converging to some (u*,y*) G 
(p;R”) X ([0,r] X 17, Pro(ji°, Lefe ® P; R”) . Linearity arguments allow one to 
identify Y* = and the semicontinuity of the L^-norm w.r.t. the weak topol¬ 

ogy to infer that yi'-’' G KerB* , P®I/efe — a.s. on 17 x [0,T]. We have, thus, shown 
that y £ Viabigf, (KerB*). 

Step 2. We proceed as in the first part of the previous step. Let us fix y G 
Viabiiy^ (KerB*), T > 0 and v £ C? (p; R") such that G KerB* , P(g)Le6 — a.s. 
on 12 X [0,T]. Whenever t <T, 
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Using Fatou’s Lemma, one gets that 


E 


liminf< E /" [ \vs (6)\^ i'(d9) ds 

\ /} Jo Je 


Hence, liminfVj*'’’'') < oo, P—a.s. and, using the first step, Y^'’" e 

N^oo \ / 

Viabi^^ [KerB *), P—a.s. The conclusion follows by recalling that Y.^'^ is cadlag. 


Remark 5 The definition of IK can, equivalently, be given as 


. = ■{ 1 / € M" : 3r > 0 s.t. lim ( y,y) < oo, for all 0 < t < T 


} 


In particular, this implies that Viabioi, {KerB*) = K is a linear subspace of KerB*. 


As a consequence, we get the following criterion for the approximate and ap¬ 
proximate null-controllability in the case when the coefficients are constant. 


Criterion 3 The system 0 is approximately null-controllable iff it is approximately 
controllable. The necessary and sufficient condition for approximate controllability is 
that the largest subspace Vq C KerB* which is {A*',0*Tly^)-invariant be reduced to 
{ 0 }. 


Proof Approximate controllability implies approximate null-controllability, which, 
by Proposition[2] implies that the largest subspace Vo C KerB* which is {A* - C*nyff)- 
invariant is reduced to {0}. 

For the converse we proceed as in the proof of Proposition [3l Let us just hint 
the modifications needed to this proof. One begins by applying Ito’s formula to 
{I - ny,ab,^AKerB‘)) (instead of U/’’')- Whenever = 

0, P(8)I/e6 almost everywhere on 17 x [0,r], it follows, due to the previous result, 
that T/’" G Viabioc {KerB*). Hence, reasoning as in Proposition [3l 


0 = E 


/ / ~ ^ViabiaciKerB*)) {d)\ V {d9) ds 

Jo Je 


Then vt (9) G Viable,, {KerB *), P g) Leb (g> u almost everywhere on 17 x [0,r] x E. 
Reasoning as in Proposition [3] (but this time globally, not only prior to the first 
jump time), we get T/’” G V, almost everywhere on 17 x [0,r]. Here V C KerB* 
is the linear subspace 


f y' G KerB* : 3u G {E, B {E) , u; Viabi^c {KerB*)) 
\ A*y' + C*u G V. 



( 9 ) 


We recall that y is arbitrary in Viabi^^ {KerB*) to get Viabi^^ {KerB*) C V and, 
thus, V is included in the largest subspace Vo of KerB* which is {A*-,C*Ily^)- 
invariant. By assumption, Vo = {0}. Hence, Y^’^ = 0, almost everywhere on 17 x 
[0, T] which implies approximate controllability of ([7]). The proof is now complete. 
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Remark 6 This result is the counterpart of 0 in this jump-framework. As in the 
cited paper, it turns out that the two notions of approximate controllability co¬ 
incide. Moreover, their characterization is given, similar to in terms of strict 
invariance. However, while in the Brownian setting the operators are finite, here 
we have an operator C* acting on L^. Except the case when E is finite, algorithms 
are more difficult to implement in this setting. 


Since, in this particular framework, we are able to completely characterize 
the (equivalent) approximate controllability properties, we can produce a simple 
example in which the condition given by Proposition [3] is not satisfied, yet the 
system is approximately controllable. Hence, although sufficient, this condition is 
not (always) necessary in the study of approximate controllability. 


Example 4 We let n = 3, d = 1, E = {0, 1}, B : = 



0, A(0) = A(l) = 1, 


Q {0,d9) = (5i (dd), Q (l,d0) = So (d9). We denote, as before, by ei = f j >®2 = 


O' 


O' 


1 ,63 = 0 • One easily notes that Ker{B*) = span ( 62 , 63 ). We let A := 

, 0 / \lj 

'ooo\ 

1 0 0 I , C (0) = C (1) = C := I 0 0 0 I . The reader is invited to note that 

010/ looo/ 


A* (y 62 + zez) = y 6 i+z 62 , C* (y 62 + 263 ) = 0 and (C* -t- I) (yez + 263 ) = y 62 +z 63 . 
Hence, the largest subspace Vo C K 6 rB* which is (A*; )-invariant (i.e A*- 

invariant) is Vo = {0}. It follows that the system Q is approximately control¬ 
lable. However, the space span ( 63 ) is (A*;(C* -|-ir)dIiferB*)-iiivariant and, thus, 
the condition of Proposition |3] is not satisfied. 


4.2 The Continuous Switching Systems 


The next class of systems we address is the case in which the dynamics are only 
switched but no jump takes place on the X component. In other words, following 
the behavior of 7 , the matrix A is different (A ( 7 )), but a change in the mode 7 
does not induce an instantaneous change of the process X. This corresponds to the 
particular choice C = 0. In this case, we consider a switch piecewise linear system 

/dAf“ = [A(7,)Af“ + HsU«]ds, s>0, 

The reader is invited to note that whenever spikes appear, they do not modify the 
current X component but merely the vector held. 

The main result in this framework is the following criterion. 


Criterion 4 The system m is approximately null-controllable if and only if the 
largest subspace of Ker j which is A* ( 70 ) - invariant is reduced to the triv¬ 

ial subspace {0} for all 70 € E. 
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Let US give a proof that can be adapted for piecewise linear systems with 
mutual influence (i.e. in the case when the jump mechanism of the process 7 
equally depends on X). We refer the interested reader to 14 1 , [^, [ld| . for 


the exact construction. We will not present the rigorous framework but only give 
the proof in our case. The main difficulty in the general framework is due to the fact 
that the hltration is not fixed prior to the construction of X and that 7 itself would 
depend on the control parameter through X. In order to get a Markov process, one 
would have to use piecewise open-loop control policies (i.e., between consecutive 
jump times r„ and T„+i, the control would be of type Un {t — r„, 7 j’^,Xj'^) and 
would not depend on (Tk,^Tki^Tk)k<n-i)- proof of sufficiency, we shall 

exhibit stabilizing controls in the open-loop feedback form. 

Let us assume that the initial matrix is independent of 7 and that A ( 7 ) 
are self-adjoint and commute with 

A ( 7 ) = 4* ( 7 ) andT( 7 )B°(B°)* = B°(B°)*A( 7 ), ( 11 ) 


for all 'y £ E. This assumption is a technical one and implies, without any further 
considerations, the commutativity of Gramians and, hence, the positiveness of 
products. 


Proof The necessary condition follows from Proposition[T] since, in this framework, 
(7 = 0. 

For the converse, let us £x 70 € E, xq € K”, a time horizon T > 0 and (for 
the time being) a discretization step N > 0. We also drop the dependency of 70 
in pO’' 1 'o. Since the largest subspace of Ker which is A* ( 7 ) - invariant is 

reduced to the trivial subspace {0} , it follows that the controllability Gramian 

is invertible for all t > 0. Due to m, one has, for every 0 < t <t', 

gA( 7 )(t-s )^0 ^^ 0 ^* g, 4 *( 7 )(t-s)gA( 7 )(t'-r )^0 ( 7 ) (t'-r) 

= -r) qO ^j^oy j^O ^ 73 °^ * ^,4* ( 7 )(t-s) 

Integrating this equality with respect to the Lebesgue measure for (s, r) G [0, f\ x 
[O, t'] , one gets 

G ( 7 , i) Q ( 7 , t') = Q ( 7 , i') Q ( 7 , i) ■ 

Whenever t' > 0, one also has 


Q{7,t)Q ^{7A')=Q ^ {7A')Q ixA) ■ (12) 

Hence, in this commutating framework, Q ( 7 ,1)5”^ ^"1®° positive definite 

(except when t = 0 and the product is 0). We dehne the (square norm) minimal 
action (in time ■^) 
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for every 'y € E, y £ 
control sequence 




t > 0 and consider the trajectory X associated to the 

if Af > n > 1 , , . 

, i.e. to the control 

n>l 


0 , otherwise 


ut 


:= {'yo,xo,t) lo<t<Ti + X! ^ - Tn-l) lT„_i<t<T„- 


n>2 


(The trajectory is constructed cu-wise between any two consecutive jump times. 
Obviously, with this kind of construction, u can also act on on A and on Q. 
For more detailed construction, the reader is referred to 0 : ES- 0 : 0 > etc.). 
Then = 0 on (Ti > ^) U (Tz - Ti > ^) U ... U (Tjv - T^-i > ^) ■ Up to Ti, 

the explicit solution of our equation with mode 70 and initial data 0:0 is given by 

j^Xo,U 

In view of m and (ED, we get that 

is positive dehnite (or 0 is t = 0). On the other hand, since 



it follows that 

which implies < e““* |a:o| , for all t < ^ A Ti. Here, ao stands for an upper 

bound of the norm of linear operators A ( 7 ). Repeating this argument, it follows 
that 

for all t > 0. We deduce that 
E 

< |a:o|"P < ^) n (t2-T^ < n... n (tn-Tn-1 < 

where cq is an upper bound for the jump intensities A ( 7 ). Since A'" > 0 is arbi¬ 
trary, it follows that our system is approximately null-controllable and our proof 
is complete. 
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Finally, we note that, in this particular setting, the Riccati equation would be 
a true, backward one and have the form 

■dK^ 

= A* (70 + 4 (70 (^) ? idt,de) 

+ A ( 7 t) fff {9)* (/ + + hP (0)) (9) Q ( 7 *, d9) dt, t € [0, T]. 

= 0, 7 + R'f + 77f {0) > 0, for almost all t £ [0,T]. 

Unfortunately, the same approach as in the previous section fails to work since we 
are unaware of a reference for the results on this type of equation. 


5 Conclusions and Perspectives 

In this paper we have studied the approximate null-controllability property for a 
class of jump Markov piecewise linear switched processes. These models are in¬ 
spired by lytic cycles in biological systems and prediction problems in mathemat¬ 
ical finance (energy markets). We have exhibited several necessary conditions and 
established specific frameworks of sufficiency of these algebraic criteria (indepen¬ 
dent coefficients or continuous jump mechanism). Counterexamples are provided 
in the general case establishing the independence of these conditions. We have tried 
to emphasize the stochastic characteristics of our problem. We have shown that, 
as soon as jumps occur, the controllability cannot be inferred from the analogous 
property of the related deterministic systems. For the general framework, we have 
also proposed a sufficiency criterion again based on algebraic invariance. Although 
very close to the necessary criteria, this sufficient condition can be weakened in 
the case of constant coefficients (in Example 0]). Our approach shows that weaker 
invariance is sufficient as soon as local viability with respect to the forward system 
can be obtained. 

In order to relax the sufficient condition (following the method described for 
constant coefficients in Subsection 01) . one would try to characterize the local 

viability kernel of Ker (7o))*j • To this purpose, one would be led to consider 
the backward stochastic Riccati equation 

■ dK^ 

= [k^A* (7t) + A (70 Af - dt + T/f (9) q {dt, d9) 

' +Ie^ M (/f (^)) * /f W Q (7t, d9) dt, 

where /O' {9) := (c (9) Af - Af (0)) , t G [0, T]. 

= 0, 7 -h Af + Af (61) > 0, for almost all t G [0,T]. 

Of course, the existence of a unique solution to this equation in the general case 
is quite a difficult problem. For particular problems, we hope to be able to give 
a solution by aggregating deterministic solutions (following the approach for less 
restrictive one-dimensional BSDE given in Q ). Since all our counterexamples con¬ 
cern bimodal systems, we are currently working on algebraic conditions which are 
intermediate between the necessary and sufficient criteria proposed in the present 
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paper. This class is also relevant for the link between approximate and approx¬ 
imate null-controllability. Finally, fnture work will concern branching piecewise 
linear mechanisms to respond to the intnitive prediction method in energy mar¬ 
kets. 
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